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IMAGE COLOR TRANSFORMATION TO 
COMPENSATE FOR REGISTER SATURATION 

TECHNICAL FIELD 

[0001] The invention relates to image control. More particularly the invention relates 
to adjustment of image intensity compensation in response to register saturation. 

BACKGROUND 

[0002] Because batteries provide power to operate a laptop computer or other 
portable electronic device for a limited period of time, a need exists to efficiently use the 
power available to provide the longest possible operating period. This need has resulted 
in various power saving techniques such as, for example, shutting down or reducing 
power in components that are not being heavily used, or where policy is to prefer power 
savings over performance. 

[0003] One component that can have it's power reduced during periods of inactivity 
or when power conservation is preferred is the LCD panel and backlight. In a typical 
laptop computer, for example, the display can consume 30% or more of the power 
consumed by the system. In order to reduce display power consumption, some laptop 
computer systems reduce the panel backlighting when in battery-powered mode. 
However, because LCDs are transmissive display devices (i.e., LCDs depend on the 
quantity and quality of the backlight source for producing the perceived color gamut), 
reduction of backlight brightness alone results in an image that the user often perceives as 
of lower quality than the same image with a brighter backlighting. 
[0004] Display image quality is further effected by ambient light surrounding the 
display, which can reduce the environments in which a user may feel comfortable using a 
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battery powered device that adjusts the backlight to save power, which is especially 
important considering the self-contained battery power-source is one of the key factors 
facilitating mobility that allows the use to move at will between different indoor and 
outdoor environments. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is illustrated by way of example, and not by way of limitation, in 
the figures of the accompanying drawings in which like reference numerals refer to 
similar elements. 

Figure 1 is a block diagram of one embodiment of an electronic system. 

Figure 2 illustrates a cross-section of one embodiment of a flat-panel display 
monitor. 

Figure 3 illustrates a group of pixels within a flat-panel monitor screen. 

Figure 4 illustrates one embodiment of a light emitting diode (LED) backlight for 
a notebook computer display system. 

Figure 5 illustrates one embodiment of a display system. 

Figure 6 is a conceptual illustration of a histogram in which a brightness value 
causes register saturation. 

Figure 7 is a conceptual illustration of the histogram of Figure 6 in which excess 
pixel data has been reassigned to a neighboring non-saturated register. 

Figure 8 is a conceptual illustration of the histogram of Figure 7 in which excess 
pixel data has been reassigned to a neighboring non-saturated register. 

Figure 9 is a flow diagram of one embodiment of reassignment of excess pixel 

data. 



42P 17653 



-4- 



Express Mail No. EV 325527241 US 



DETAILED DESCRIPTION 

[0005] Methods and apparatuses for image color compensation are described. In the 
following description, for purposes of explanation, numerous specific details are set forth 
in order to provide a thorough understanding of the invention. It will be apparent, 
however, to one skilled in the art that the invention can be practiced without these 
specific details. In other instances, structures and devices are shown in block diagram 
form in order to avoid obscuring the invention. 

[0006] As described in greater detail below, backlight image adaptation (BIA) is a 
technique that can provide power savings by dynamically brightening the color of a 
displayed image through modifications to a graphics color look-up table with a 
corresponding decrease in backlight intensity. The image brightening with a 
corresponding decrease in backlight intensity results in a displayed image that is 
comparable in user-perceived brightness to the original image. In one embodiment, the 
BIA technique utilizes an image brightness histogram in order to detect and respond to 
meaningful changes in the displayed image. Alternatively, changes in image brightness 
can be detected without use of a histogram representation. 

[0007] The brightness histogram, or other brightness monitoring technique, uses a set 
of hardware registers to store a number pixels in the image corresponding to various 
brightness values. That is, pixels are mapped to the registers based on computed 
brightness values. Because under certain conditions the number of pixels in an image can 
exceed the number that can be stored in a register, one or more registers may fail to 
provide a proper indication of the number of pixels that correspond to a particular 
brightness. This is referred to as "saturation" of the register. 
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[0008] Saturation can result be the result of one or more conditions. For example, 
brightness histograms (described in greater detail below) are generally computed using 
hardware for performance reasons. As display resolutions grow, the number of pixels 
displayed grows, which increases the possibility of register saturation. Registers are 
typically limited in size because registers are typically costly to provide. Increasing the 
size and/or number of registers increases die size, increases routing congestion and 
complexity, etc. For example, providing 256 32-bit registers for brightness histogram 
computation would solve register saturation problems, but currently would be cost 
prohibitive. Limiting the number of registers used for a brightness histogram leads to 
grouping of multiple brightness levels, which increases the probability of saturation. 
[0009] Many common conditions exist where brightness registers become saturated. 
Many computer users spend significant amounts of time using office applications (e.g., 
word processing applications, spreadsheet applications) that typically require display of 
large numbers of white, black and or gray pixels. When a large number of pixels are 
white, for example, one or more registers corresponding to relatively high brightness 
values can become saturated. 

[0010] In one embodiment, excess pixel data is reassigned to neighboring registers 
until the previously saturated register is no longer saturated. In one embodiment, excess 
pixel data is reassigned to an adjacent register corresponding to a lower brightness value. 
Excess pixel data can be reassigned to non-adjacent registers as well as registers 
corresponding to a higher brightness value. 

[001 1] The image adaptation technique described herein can be applied to a broad 
class of electronic systems having associated display devices. While the examples herein 
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a generally directed to laptop computers, the techniques described can be applied to 
personal digital assistants (PDAs), palm top computers, desktop computers using flat 
panel displays, kiosk displays, etc. Figure 1 is a block diagram of one embodiment of an 
electronic system. Electronic system 100 includes processor 102 coupled to bus 105. In 
one embodiment, processor 102 is a processor in the Pentium® family of processors 
including the Pentium® II processor family, Pentium® HI processors, Pentium® 4 
processors, and Pentium-M processors available from Intel Corporation of Santa Clara, 
California. Alternatively, other and/or other processors may be used, such as Intel's 
StrongArm processor, XScale processor, ARM processors available from ARM Ltd. of 
Cambridge, the United Kingdom, or OMAP processor (an enhanced ARM-based 
processor) available from Texas Instruments, Inc., of Dallas, Texas. 
[0012] Memory Control Hub (MCH) 1 10 is also coupled to the bus 105. MCH 110 
may include memory controller 1 12 that is coupled to memory system 115. Memory 
system 115 stores data and sequences of instructions that are executed by processor 102 
or any other device included in electronic system 100. In one embodiment, memory 
system 115 includes dynamic random access memory (DRAM); however, memory 
system 115 may be implemented using other memory types, for example, static random 
access memory (SRAM), or other configurations of integration, for example processor 
including memory controller. Additional devices not included in Figure 1 may also be 
coupled to bus 105 and/or MCH 110. 

[0013] MCH 110 may also include graphics interface 113 coupled to graphics device 
130. In one embodiment, graphics interface 113 includes an accelerated graphics port 
(AGP) that operates according to an AGP Specification Revision 2.0 interface or PCI- 
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Express Interface developed by Intel Corporation of Santa Clara, California. In another 
embodiment graphics device may be integrated with MCH forming a GMCH (Graphics 
and Memory Controller Hub). Other embodiments may be possible such as when MCH 
is integrated with the processor and Graphics Controller. In all cases Graphics Controller 
portion is referred to as Graphics Interface wherever contained therein. 
[0014] In one embodiment, a flat panel display may be coupled to graphics interface 
113 through, for example, a signal converter that translates a digital representation of an 
image stored in a storage device such as video memory or system memory into display 
signals that are interpreted and displayed by the flat-panel screen. Display signals 
produced by the display device may pass through various control devices before being 
interpreted by and subsequently displayed on the flat-panel display monitor. Other 
graphics interfaces and protocols can also be used. 

[0015] MCH 1 10 is further coupled to input/output control hub (ICH) 140, which 
provides an interface to input/output (I/O) devices. ICH 140 may be coupled to, for 
example, a Peripheral Component Interconnect (PCI) bus adhering to a Specification 
Revision 2.1 bus developed by the PCI Special Interest Group of Portland, Oregon. 
Thus, in one embodiment, ICH 140 includes PCI bridge 146 that provides an interface to 
PCI bus 142. PCI bridge 146 provides a data path between processor 102 and peripheral 
devices. In another embodiment MCH and ICH are integrated together and also include 
PCI or other device/bridge function. In one embodiment, PCI bus 142 is coupled with 
audio device 150 and disk drive 155. However, other and/or different devices may be 
coupled to PCI bus 142. In addition, processor 102 and MCH 110 could be combined to 
form a single chip. 
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[0016] In addition, other and/or different peripheral devices may also be coupled to 
ICH 140 in various embodiments. For example, such peripheral devices may include 
integrated drive electronics (IDE) or small computer system interface (SCSI) hard 
drive(s), universal serial bus (USB) port(s), a keyboard, a mouse, parallel port(s), serial 
port(s), floppy disk drive(s), digital output support (e.g., digital video interface (DVI)), 
and the like. Moreover, electronic system 100 can receive electrical power from one or 
more of the following sources for its operation: a battery, alternating current (AC) outlet 
(e.g., through a transformer and/or adaptor), automotive power supplies, airplane power 
supplies, and the like. 

[0017] Figure 2 illustrates a cross-section of one embodiment of a flat-panel display 
monitor. In one embodiment, display signals 205 generated by a display device, such as 
a graphics accelerator, are interpreted by flat-panel monitor control device 210 and 
subsequently displayed by enabling pixels within flat-panel monitor screen 215. The 
pixels are illuminated by backlight 220, the brightness of which effects the brightness of 
the pixels and therefore the brightness of the displayed image. 

[0018] As described in greater detail herein, the brightness of backlight 220 can be 
adjusted to provide more efficient power usage, to provide appropriate brightness based 
on ambient conditions, and/or to compensate for image intensity changes. The color 
intensity values for the pixels can also be adjusted based on ambient conditions and/or 
backlight intensity. 

[0019] Figure 3 illustrates a group of pixels within a flat-panel monitor screen. In 
one embodiment, the pixels are formed using thin film transistor (TFT) technology, and 
each pixel is composed of three sub-pixels 302 that, when enabled, cause a red, green, 
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and blue (RGB) color to be displayed, respectively. Each sub-pixel is controlled by a 
TFT (e.g., 304). A TFT enables light from a display backlight to pass through a sub- 
pixel, thereby illuminating the sub-pixel to a particular color. Each sub-pixel color may 
vary according to a combination of bits representing the sub-pixel. The number of bits 
representing a sub-pixel determines the number of colors, or color depth, that may be 
displayed by a sub-pixel. Sub-pixel coloring is known in the art and any appropriate 
technique for providing sub-pixel coloring can be used. 

[0020] A brighter or dimmer luminance of a color being displayed by a pixel can be 
achieved by scaling the value representing each sub-pixel color (red, green, and blue, 
respectively) within the pixel. The particular values used to represent different colors 
depends upon the color-coding scheme, or color space, used by the particular display 
device. By modifying the color luminance of the sub-pixels (by scaling the values 
representing sub-pixel colors) the perceived brightness of the display image may be 
modified on a pixel-by-pixel basis. 

[0021] In one embodiment, color luminance is adjusted via modification of the color 
look-up table (gamma table) inside the graphics controller, which adjust the sub-pixel 
colors prior to being sent to the display device. In another embodiment the pixel may be 
adjusted directly without using a look-up table for example by converting the pixel to a 
color-space in which the pixel color luminance is expressed, and then adjusting that term 
given the desired change in luminance, prior to passing the pixel to the display device. 
[0022] Furthermore, by modifying the color shade of each pixel, the amount of 
backlight necessary to create a display image of a particular display image quality can be 
modified accordingly. For example, increased brightness caused by manipulation of the 
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color look-up table to provide opportunity to decrease backlight intensity and therefore a 
reduction in power consumption. 

[0023J Figure 4 illustrates one embodiment of a light emitting diode (LED) backlight 
for a notebook computer display system. In one embodiment, LED backlight 400 
includes modulator 402, and LED stick 404, which includes LEDs 406. For example, 
LED stick 404 can include any number of LEDs. In one embodiment, LEDs 406 are 
white LEDs; however, LEDs 406 can be, for example, blue or ultraviolet LEDs. 
Modulator 402 receives power from power source 410, which can be a battery (e.g., a 12 
Volt battery) or other power source. Modulator 402 controls the intensity of backlighting 
provided by LEDs 406. 

[0024] Figure 5 illustrates one embodiment of a display system. Display device 500 
generates display signals 505, which enable timing controller 510 to activate appropriate 
column and row drivers 5 1 5 to display an image on flat-panel display monitor 520. Flat- 
panel monitor 520 may be an LCD, plasma, or any type of flat-panel display. 
[0025] In one embodiment, display device 500 includes modulator 402, blender unit 
530, and conversion table (also referred to as a gamma unit) 545. As described above, 
modulator 402 controls luminance (brightness) of backlight 540. In one embodiment, 
modulator 402 may include, or be coupled with, an integrated inverter, for example, an 
industry Siemens flat panel display technology (I-SFT) inverter. 
[0026] In an embodiment, blender unit 530 creates an image to be displayed on the 
display monitor by combining a display image with other display data, such as texture(s), 
lighting, and/or filtering data. These techniques are known in the art. In one 
embodiment, the display image from blender unit 530 and the output of gamma unit 545 
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can be combined generate display signals 505, which are transmitted to timing controller 
510, as discussed above. 

[0027] Graphics gamma unit 545 effects the brightness of an image to be displayed 
by scaling each sub-pixel color. In one embodiment, graphics gamma unit 545 can be 
programmed to scale the sub-pixel color on a per-pixel basis in order to achieve greater 
brightness in some areas of the display image, while reducing the brightness in other 
areas of the display image. 

[0028] In one embodiment, display image brightness indicators 550 include data 
indicating image brightness determined by monitoring and accumulating pixel color 
within the display image. The display image brightness indicators can then indicate to 
control logic 555 the brightness of certain features within the display image, such as 
display image character and background brightness. Control logic 555 can be 
implemented as hardware, software or a combination of hardware and software. 
[0029] In one embodiment, control logic 555 receives signals from an ambient light 
sensor and determines the environment the display is being used in to, for example, adjust 
the display characteristics (such as brightness and/or contrast) accordingly. In one 
embodiment, control logic 555 generates a histogram of pixel brightness values that are 
stored in a set of registers. Under certain conditions, one or more of the registers can 
become saturated, which can lead to image degradation and/or less than optimal dynamic 
backlight adjustments. 

[0030] Figure 6 is a conceptual illustration of a histogram in which a brightness 
value causes register saturation. The horizontal axis of Figure 6 corresponds to 
brightness values for the pixels of an image to be displayed. For example, if 256 
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brightness values are supported, the brightness axis can have values 0-255, where 0 
indicates no brightness (i.e., the corresponding pixel receives no light) and 255 indicates 
maximum brightness for the pixel. The vertical axis indicates the number of pixels in the 
image to be displayed that correspond to the individual brightness values. 
[0031 J In one embodiment, a set of registers are used to store computed brightness 
values. For example, 256 registers can be used to store the number of pixels in a picture 
having the respective brightness values, A different number of registers can also be used. 
Because the total number of pixels in the image to be displayed exceeds the capacity of 
the register, the exact number of pixels having a brightness corresponding to a saturated 
register is unknown. 

[0032] As described above, the overall brightness of an image can be dynamically 
adjusted through modification of the color look-up table. However, without the ability to 
identify the overall brightness of the image to be displayed, image and/or corresponding 
backlight intensity adjustments may not be optimal. In one embodiment, when a register 
becomes saturated, the "excess pixel data" is shifted to a non-saturated register 
corresponding to a similar brightness. 

[0033] Pixel data can be accumulated by, for example, incrementing a value stored in 
a brightness register when a pixel having the corresponding brightness is processed. 
When the register reaches the saturation threshold, when subsequent pixels of the 
saturated brightness are processed, a neighboring brightness register can be incremented. 
Other techniques for reassigning excess pixel data can also be used. 
[0034] In the example that follows (Figures 6-8), excess pixel data is shifted to a 
closest non-saturated register having a lower brightness value. In alternate embodiments, 
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the excess pixel data can be reassigned in a different manner. For example, the excess 
pixel data can be shifted to registers corresponding to brightness levels two or more 
levels away from the saturated register and/or the pixel data can be shifted to registers 
corresponding to a higher brightness value. 

[0035] In Figure 6, the dashed area above the "register saturation lever' line indicates 
the magnitude of the excess pixel data. However, during operation the control logic 
cannot evaluate the magnitude of the excess pixel data because the data cannot be stored 
in a register that has become saturated. Therefore, the excess pixel data as indicated by 
the dashed area above the register saturation level line is "shifted" to a non-saturated 
register. 

[0036] Figure 7 is a conceptual illustration of the histogram of Figure 6 in which 
excess pixel data has been reassigned to a neighboring non-saturated register. In the 
current example, the shifted excess pixel data also saturates the non-saturated register. In 
another embodiment, the excess pixel data is shifted to a nearest non-saturated register 
whether or not the shifting will saturate the target register. In an alternate embodiment, 
the excess pixel data is shifted to a non-saturated register that will not be saturated by the 
excess pixel data. 

[0037] In one embodiment, when the excess pixel data saturates the previously non- 
saturated register to which the data are shifted, the excess pixel data from the newly 
saturated register is shifted to a non-saturated register. Figure 8 is a conceptual 
illustration of the histogram of Figure 7 in which excess pixel data has been reassigned to 
a neighboring non-saturated register. When all, or a sufficient portion of, the excess pixel 
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data has been reassigned, the control logic can perform image brightness and backlight 
intensity compensation. 

[0038] Figure 9 is a flow diagram of one embodiment of reassignment of excess 
pixel data. Control logic determines whether any of the brightness registers are saturated, 
910. The control logic can be implemented as hardware, software or a combination of 
hardware and software. In the example above, saturation of a register is described as a 
number of pixels of a brightness corresponding to a register exceeding the number of 
pixels that can be counted by the register. However, any threshold value can be used to 
identify a saturated register. 

[0039] If one or more registers are saturated, the excess pixel data corresponding to 
the saturated register(s) is/are reassigned using one of the techniques described above, 
920. In one embodiment, reassignment is performed as many times as is necessary to 
achieve a state in which none of the registers is saturated. In an alternate embodiment, 
reassignment can be performed a predetermined number of times. 
[0040] When none of the registers are saturated, image brightness adjustment and/or 
corresponding backlight intensity adjustment can be performed, 930. In one 
embodiment, using the brightness data from a histogram stored in the registers, the 
overall brightness of the image to be displayed is determined. The brightness of one or 
more pixels in the image can be increased with a corresponding decrease in backlight 
intensity, which provides better battery life than in a non-adjusted image. In one 
embodiment, an ambient light senor is used to determine a desired brightness level to be 
provided by the brightness of the image and/or backlight intensity. 
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[0041] Reference in the specification to "one embodiment" or "an embodiment" 
means that a particular feature, structure, or characteristic described in connection with 
the embodiment is included in at least one embodiment of the invention. The 
appearances of the phrase "in one embodiment" in various places in the specification are 
not necessarily all referring to the same embodiment. 

[0042] In the foregoing specification, the invention has been described with reference 
to specific embodiments thereof. It will, however, be evident that various modifications 
and changes can be made thereto without departing from the broader spirit and scope of 
the invention. The specification and drawings are, accordingly, to be regarded in an 
illustrative rather than a restrictive sense. 
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